Theory of enhanced performance emerging in a 
sparsely-connected competitive population 



T.S. Lo 1 , K.P Chan 1 , P.M. Hui 1 , and N.F. Johnson 2 
Department of Physics, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong 
2 Physics Department, University of Oxford, Clarendon Laboratory, Oxford 0X1 3PU, U.K. 

(Dated: February 2, 2008) 

We provide an analytic theory to explain Anghel et al.'s recent numerical finding whereby a 
maximum in the global performance emerges for a sparsely-connected competitive population [Phys. 
Rev. Lett. 92, 058701 (2004)]. We show that the effect originates in the highly-correlated dynamics 
of strategy choice, and can be significantly enhanced using a simple modification to the model. 
PACS numbers: 02.50.Le, 05.65. +b, 87.23.Ge, 89.65.Gh 



There are two particularly active areas of research into 
Complex Systems among physicists: multi-agent popu- 
lations [USQ and complex networks 0j. Arthur's bar- 
attendance problem Q and its binary Ising-like simpli- 
fications (e.g. the Minority Game (MG) 0, Q) consti- 
tute everyday examples of multi-agent competition for 
limited resources. However researchers have only just 
started considering combining networks with such multi- 
agent systems 0, E| . Anghel et al. reported some fas- 
cinating numerical results in which the fluctuation in the 
number of agents taking a particular action can exhibit 
a minimum at small connectivity (see Fig. 1 inset). It is 
truly remarkable that there exists an optimal number of 
network connections such that the overall system perfor- 
mance is maximized, and that this optimal connectivity 
is actually quite small. 
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FIG. 1: Mean success rate {w) and fluctuation a (inset) as 
a function of connectivity p for m = 1, with N — 101 and 
s — 2. Symbols are numerical results. Lines are theoretical 
results. Inset shows the minimum in the fluctuation a 5] • 



Anghel et al.'s results have so far lacked any theoret- 
ical explanation, yet they represent an important chal- 
lenge for physics - not just because of the potential ap- 
plication areas but also because they expose our limited 
understanding of complex dynamical networks. Here we 
provide the first analytic theory which explains their re- 
markable finding. The essential underlying physics com- 
prises (i) the highly correlated, non-random temporal 
evolution of strategy scores, (ii) the tendency to link to 
future winners (losers) at low (high) connectivity p, and 
(iii) the emergence of different species of agent character- 
ized by the relative Hamming distance D of their strate- 
gies. The importance of the underlying dynamics means 
that approaches based on assumptions of random histo- 
ries, e.g. spin-glass theories, are invalid. Our theory also 
shows that network connections play a crucial role, even 
when only a tiny fraction exist. This enables us to pro- 
pose a minor modification to Anghel et al.'s model which 
provides significantly enhanced global performance. In- 
terestingly, there is recent empirical evidence to suggest 
that our proposed 'second-best' rule does actually arise 
in everyday life Q. Our theory in the zero-connectivity 
limit (i.e. p — 0) also provides a new microscopic theory 
for the MG. Note that the theory we present does not 
benefit from the simplifications and hence beauty of con- 
ventional many-body theory in physics. This is because 
- in contrast to conventional physical systems - the dy- 
namics and configuration space are now so closely inter- 
twined. However it is precisely this feature which makes 
the problem so interesting for a theoretical physicist Q ■ 

Anghel et al.'s model features N agents who re- 
peatedly choose between two actions '1' or '0' 2]. The 
winners are those in the minority group. The global in- 
formation is the bit-string containing the m most recent 
winning outcomes (i.e. history). Each agent holds s = 2 
strategies. Each strategy is one of the 2 2 possible map- 
pings from the 2 m histories to action '1' or '0'. All strate- 
gies collect one virtual point (VP) if they predicted the 
winning outcome correctly, while each agent collects one 
(real) point if he wins. The mean success rate (w) is the 
average number of real points per agent per turn. The 
agents are connected by an undirected random network 
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with p being the probability that a link between two ran- 
domly chosen agents exists. Each agent compares the cu- 
mulated performance of his best-performing strategy (i.e. 
his predictor) with that of his neighbors, and then follows 
the prediction of whoever holds the best-performing pre- 
dictor, including himself. The p = limit of the model 
reduces to the MG. The identity of the best-performing 
strategy changes over time, and for p > the predictor's 
performance is generally different from the agent's per- 
formance. Figure 1 (inset) illustrates the minimum in 
fluctuation arising at finite p ||, together with (w) as a 
function of p for m — 1. Since these quantities are simply 
related, we focus here on (w). 

The features of interest occur at small m and small 
p, hence we focus on the explicit example of m = 1 
(see Fig. 1) and make the reasonable assumption that 
the predictors' performance can be approximated by the 
p = results. Generalization to m — 2, 3 . . . and s > 2 
is straightforward but lengthy. For p — and small m, 
no single strategy outperforms the others (i.e. no run- 
away VPs) and the system restores itself in a finite (m- 
dependent) number of timesteps. The Eulerian trail acts 
as a quasi-attractor of the system's dynamics 0, yield- 
ing anti-persistent behavior whenever the system revisits 
a given history node on the de Bruijn graph of possible 
history bit-strings. Let {t" ven } {{t u odd }) be a set consist- 
ing of the turns in a history series at which a particular 
history v occurred an even (odd) number of times from 
the beginning of the run until the moment of the current 
history fi. For t £ {teven}i tne a g en ts decide randomly 
since the strategy scores are not biased. For t £ {t^ dd }, 
the success rate is determined by: (i) The number of 
histories k that had occurred an odd number of times 
at the moment of decision. Since there are 2 m histo- 
ries, we have < k < 2 rn . (ii) The Hamming distance 
d between an agent's best-performing strategy and the 
best performing strategy among all strategies (BPS) at 
that particular turn, (iii) The Hamming distance D be- 
tween the strategies that an agent holds. For s = 2, the 
probability that the strategies are separated by a Ham- 
ming distance D is given by the binomial coefficient C|, , 
where D = 0, 1, . . . , 2 m . For m — I , there are on average 
N/4 agents belonging to the D — 'species' (i.e. two per- 
fectly correlated strategies), N/2 in the D = 1 'species' 
(i.e. two uncorrelated strategies), and N/4 in the D = 2 
'species' (i.e. two anticorrelated strategies). For m = 1, 
k = 0, f or 2 since there are two possible history bit- 
strings. Consider a particular time t corresponding to 
k = 0: t £ {t^ ven } for both histories assuming the system 
follows the Eulerian trail. Hence the agents become dy- 
namically segregated by their performance, according to 
their D value. As we now explain, N/4 (D = 0) agents 
should have a score of t/2, N/2 (D = 1) agents should 
have a score of 3t/8, and N/4 (D = 2) agents should 
have a score of 5i/16, in the long time limit. Prior to 
a current history of, say, 0, each history bit (1 and 0) 
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FIG. 2: Numerical (symbols) and theoretical (lines) results 
for the average success rate wd of the D = 0, 1, 2 agents as a 
function of p. 

has occurred an even number of times. The strategies 
are all tied. The outcome is thus random (i.e. coin-toss). 
Agents with a given D might have won with probabil- 
ity u^=o"^ ~ or l° st w ' tn probability (I — 11^=0™^) 
and hence there are two subgroups (i.e. won or lost) of 
agents for a given D, with different sizes. Regardless of 
the outcome, the system now corresponds to k = 1 and 
the agents' scores can be classified into six groups. We 
denote the groups by the label {D,Y} K , where k gives 
the number of history bit-strings occurring an odd num- 
ber of times (0 < k < 2 m ) and Y is the net number of 
times that the group has won (i.e., number of winning 
turns minus number of losing turns) starting from the 
most recent occurrence of k — 0. If the outcome is 0, 
then t £ {t^ dd }. For the D — species, their strategies 
do not allow them to change their action and hence the 
agents who won in the last occurrence (carrying the label 
{0, l}i) will definitely lose and those who lost (carrying 
the label {0,0}i) will definitely win, a situation denoted 
by the winning probabilities ^o.i}! = and S{o,o}i = 1- 
For the D — I species (i.e. two uncorrelated strategies), 
those agents who won in the last occurrence of the his- 
tory (carrying the label {1, l}i) must hold a strategy 
that points to the most recent winning option, and hence 
they will make the same choice - they will definitely lose 
due to the crowd effect. For those who lost, their win- 
ning probability depends on whether their two strategies 
give the same or different predictions for the history con- 
cerned. For those agents with strategies giving the same 
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(different) prediction(s) (for history in our example), 
they will lose (win). Thus the group of agents labelled 
by {l,0}i will have an average winning probability of 
£n,0}i = 1/2. For the D = 2 species, these agents' anti- 
correlated strategies give different predictions and hence 
they will definitely lose, i.e., S{2,i}i = <^{2,0}i = 0- 

If the outcome is 1 instead of 0, the situation corre- 
sponds to k = 1 since the history has occurred an odd 
number of times and t € {t^ ven } since the current history 
1 occurred an even number of times. The strategies' VPs 
do not indicate a preference and hence do not lead to a 
crowd effect. In this case, each of the six groups of agents 
has a probability of w^Z\ of winning. As a result, 
the population will subsequently be grouped into nine 
groups according to the agents' performance in the last 
two turns, i.e. win-win, win-lose or lose- win, and lose-lose 
groups for each value of D. Regardless of the outcome, 
the system is updated to k = 2 and t £ {t^ dd }- The m " 
stantaneous BPS is the strategy that predicted correctly 
the most recent t 6 {t event outcomes for both ^ = 0, 1. 
The BPS will predict incorrectly in the following turns, 
due to the VPs' anti-persistence. The strategies with the 
second highest VPs, i.e. one correct prediction out of two 
turns, will predict correctly with probability 1/2. The 
momentarily worse-performing strategy is the one that 
predicted incorrectly for both histories at < 6 i^even}- 
However, it will predict correctly in the coming t G {t^ dd } 
timesteps. Therefore, agents holding the BPS will use it 
and are bound to lose. Hence the {D, 2} 2 groups have 
winning probabilities S{£>,2} 2 = for D = 0,1,2, since 
they hold the BPS. For the other D = agents, those 
who won (lost) in the last occurrence of the current his- 
tory will lose (win). Therefore, the winning probabilities 
are S{ ,i} 2 = 1/2 and 5 , { 0i0 } 2 = 1- For the other D = 1 
agents, their winning probabilities are 5{i ; x} 2 = 1/4 and 
S {i,o} 2 = V 2 - For D = 2, the {2,0} 2 agents must hold 
two anticorrelated strategies of second highest VPs and 
thus <S , {2,o} 2 = 1/2- F° r the {2, 1} 2 group, an agent may 
either hold (i) the BPS and the worse-performing strat- 
egy, or (ii) two strategies with the second highest vir- 
tual points. For combination (i), this agent's winning 
probability is while for combination (ii), his winning 
probability is 1/2. Averaging over these two possibilities 
gives S{2.i}, = 1/2. A common feature of the winning 
probabilities is that {£), k} k is always zero, i.e. agents 
with momentarily high-performance predictors are bound 
to lose in the following timesteps. 

This dynamics is valid for p > 0. An agent of Hamming 
distance D has an average winning probability at t £ 

{todd) for a S iven K: 
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where Njj is the number of agents with Hamming dis- 
tance D and S{D,y} K is the winning probability of the 
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FIG. 3: The mean success rate {w) as a function of connec- 
tivity p for our modified model and the model of Ref.|a] for 
m = 1. 



group of agents labelled by {D,y} K , as discussed above. 
Here N^r), y } K is the number of agents in the group 
{D,y} K which can be found using «)[ e " e ™'. For small m, 
the probabilities of occurrence of all histories are equal. 
Hence the probability of having a particular value of re is 
P(k) = C\ /2 2 . For a given value of k, the probability 
of having t e {tg dd } and t £ {t% ven } in a randomly picked 
turn is k/2" 1 and (1 — re/2 m ), respectively. Combining 
with Eq.Q, the winning probability of the agents with 
a given Hamming distance D is 
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where u>i euen ' is the winning probability for timesteps 
with t 6 {teven } and can be found by random walk ar- 
guments for p — and p ^ 0. For p = 0, Eq. (0) 
gives the segregation in success rates determined by the 
agents' 'species' type D. The overall mean success-rate 
is hence 



1 



2" 



(w) = 77 2^ W D N D- 

D=0 



(3) 



For the range of p where the important features arise, 
the agents' predictor performance is identical to the (real) 
scores or success rates at p = discussed above. For 
p ^ 0, the agents in each group {£>, y} K can be separated 
into two subgroups: 
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where Nsn,y} K is the number of agents in the 
group {D, y} K who follow their own predictor, and 
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^^{D,y} K ,{D r .j} K is the number of agents who follow 
the predictor of a neighbor belonging to group {D',j} K , 
due to the presence of links. Since agents only follow 
neighbors with better performing predictors, only links 
to neighbors in the group with labels D' < D or j > y 
(if D = D') are effective. For given p, the probability of 
an agent in {D,y} K having at least one link to agents in 
{D',j} K is 1 — q i D ''i}n ) where q = 1 — p. The number 
of agents having predictor performance better than the 
group {D, y} K is given by 

D — l K K 

A {D,y} K = E E N {UU + E N WU ■ (5) 

D'=0j=0 j>y 

The number of agents Nrr>,y} K m Eq.@ is then given by 

N {D . yU = N {DiV}K q A ^-y^, (6) 

since q A i D '-HK is the probability of the agents in group 
{D, y} K not having any links to other groups with better 
predictor performance, and so still have winning proba- 
bility S{o,y} K f° r t £ {toddl- Agents will follow the pre- 
diction of agents in {D',j} K only if (i) they have connec- 
tions to them and (ii) they do not have any connection to 
a better performing group. Therefore, ATV^^ s D , 
in Eq.Q is given by 

&N { o !yUi{D , >j}K = N {d>v}k (1 - q N ^'^ K )q A ^JU (7) 

and these agents will have the same winning probabil- 
ity S{ D ',j}„ as those in group {D',j} K for t E {t* dd }. 
Hence the mean success rate Sjd y \ K for agents labelled 
by {D, y} K for t 6 {t^ dd } is given by 

S{D,y} K = Tr i N {r>,v}K S {D,y} K + 

22&N {Di y }Ki{D , ij}K S { B>,j}J ■ (8) 

D',j 

For general p, Eq. (JTJ is modified to 

1 K ~ 
w D d * ] = J^- E N {D,v}J{D, V }„ • (9) 
y=o 

Equation can hence be used to evaluate the mean 
success rate of agents for a given D, while Eq.Q gives 
(w) as a function of the connectivity p. Equations J3J and 
© coupled with Eqs. 01-10 are our main formal results. 

Figure 1 shows (w) as a function of p. The theory can 
also be used to evaluate the fluctuation a (see inset). The 
theoretical results are in excellent agreement with the 
numerical simulations. Our theory is further validated 
in Fig. 2, where we compare theoretical and numerical 
results for the success rates wd for each species- type D. 
Each D species has a distinct p dependence, showing why 
a peak appears in the model of Anghel et ai. For small 



connectivity p, D = 1 and D = 2 agents can benefit 
by hooking up to the better performing D = agents. 
However as p increases, these agents may hook to agents 
belonging to groups with momentarily better predictor 
performance. These links hurt the agent's success rate 
since momentarily better strategies are bound to lose in 
subsequent turns. Hence the success rates of D = 1 and 
D = 2 agents will increase at small p and decrease at 
higher p, while that for D = agents decreases mono- 
tonically with p. 

Finally, having understood the underlying physics, we 
can propose a performance-enhancing modification to 
Anghel et al.'s model. Instead of following the best- 
performing agent, suppose an agent follows the second- 
best performing agent among his neighbors. Figure 3 
shows that (w) is substantially larger over a wide range 
of p. In addition, the value of p at the peak corresponds 
to a much larger number of network links. Interestingly, 
there is recent empirical evidence to suggest that such 
'second-best' rules do indeed make humans happier on 
average in everyday life |7j. 
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